-
Notifications
You must be signed in to change notification settings - Fork 6
Worker implementation for PyTorch models #94
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
| ) | ||
|
|
||
|
|
||
| # @TODO This requires loading all models into memory! Can we avoid this? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Moved this to the fastapi initialization so we don't pay the cost when running ami worker
|
|
||
| @cli.command("worker") | ||
| def worker( | ||
| pipelines: List[str] = typer.Option( |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@copilot Add the list of available pipelines to the CLI choices
Counterpart to RolnickLab/antenna#987 for an e2e implementation of the "pulling" (v2) processing service.
Adds
ami workerthat runs a worker that polls an antenna service for job tasks, processes them and posts back the result. Use: